Artificial Neural Networks that Decode Commands Embedded in the Temporal Density of Neural Spike Sequences
نویسنده
چکیده
Objectives/Goals The objective is to design Artificial Neural Units that decode commands encoded in the temporal density of neural spike sequences (each unit decodes one command) and to use them in an Artificial Neural Network to decode a multitude of such commands Methods/Materials The proposed solution involved: (1) Artificial Neural Units (ANUs), based on a very simple version of the integrate-and-fire model, designed to fire when the temporal spike density in their input exceeds a certain value; (2) Extended Artificial Neural Units (XANUs) made of ANUs and XOR operators, designed to fire when the temporal spike density of the input is bounded within a range of values; and (3) A network of command tuned XANUs that can decoded a number of different commands. A home PC was used running MS-Windows XP, MatLab for performing simulations, and the Minstorms NXT development platform to create a simple robotics application. Results Guidelines for choosing the various ANU and XANU parameters and the linear XANU network were introduced. Unit and network functionality were demonstrated with matlab simulations. Three spike sequences were considered for encoding a single command, and single and two command sequences were employed for simulations. Loss of spikes was also explored with simulations. Loss of the first or the third spike did not affect the performance of the XANUs. However, loss of the second spike did when it altered the spike density enough to be outside a XANU#s sensing range. The simple robot application was created, downloaded on the robot, and ran successfully. Conclusions/Discussion Decoding commands embedded in spike sequences could play an important role in the design and implementation of prosthetic limbs. Neural signals from the brain could be used to move artificial limbs, if they were decoded appropriately. The work in this project is only a proof of concept of such decoding devices. It illustrates how we can use ANNs to perform this type of temporal decoding reliably. ANUs are extremely simple and the XOR operator is a common component of minimal complexity. This makes the solution very attractive for hardware implementation. The potential for future work is tremendous. More complex ANUs with more inputs, more involved input path characteristics, and more complex network topologies could be used to enhance the operation of the ANUs, the XANUs, and the Artificial Neural Networks.
منابع مشابه
معرفی شبکه های عصبی پیمانه ای عمیق با ساختار فضایی-زمانی دوگانه جهت بهبود بازشناسی گفتار پیوسته فارسی
In this article, growable deep modular neural networks for continuous speech recognition are introduced. These networks can be grown to implement the spatio-temporal information of the frame sequences at their input layer as well as their labels at the output layer at the same time. The trained neural network with such double spatio-temporal association structure can learn the phonetic sequence...
متن کاملHand Gesture Recognition from RGB-D Data using 2D and 3D Convolutional Neural Networks: a comparative study
Despite considerable enhances in recognizing hand gestures from still images, there are still many challenges in the classification of hand gestures in videos. The latter comes with more challenges, including higher computational complexity and arduous task of representing temporal features. Hand movement dynamics, represented by temporal features, have to be extracted by analyzing the total fr...
متن کاملSpike timing dependent plasticity: mechanisms, significance, and controversies
Long-term modification of synaptic strength is one of the basic mechanisms of memory formation and activity-dependent refinement of neural circuits. This idea was purposed by Hebb to provide a basis for the formation of a cell assembly. Repetitive correlated activity of pre-synaptic and post-synaptic neurons can induce long-lasting synaptic strength modification, the direction and extent of whi...
متن کاملSpike timing dependent plasticity: mechanisms, significance, and controversies
Long-term modification of synaptic strength is one of the basic mechanisms of memory formation and activity-dependent refinement of neural circuits. This idea was purposed by Hebb to provide a basis for the formation of a cell assembly. Repetitive correlated activity of pre-synaptic and post-synaptic neurons can induce long-lasting synaptic strength modification, the direction and extent of whi...
متن کاملExtracting Material Information from the CT Numbers by Artificial Neural Networks for Use in the Monte Carlo Simulations of Different Tissue Types in Brachytherapy
Background: The artificial neural networks (ANNs) are useful in solving nonlinear processes, without the need for mathematical models of the parameters. Since the relationship between the CT numbers and material compositions is not linear, ANN can be used for obtaining tissue density and composition.Objective: The aim of this study is to utilize ANN for determination of the composition and mass...
متن کامل